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Recursive estimation of possibly 
misspecified MA(1) models: Convergence 
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Science Application International Corporation and U.S. Census Bureau 

Abstract: We introduce a recursive algorithm of conveniently general form 
for estimating the coefficient of a moving average model of order one and 
obtain convergence results for both correct and misspecified MA(1) models. 
The algorithm encompasses Pseudolinear Regression (PLR — also referred to 
as AML and RMLi) and Recursive Maximum Likelihood (RML2) without 
monitoring. Stimulated by the approach of Hannan (1980), our convergence 
results are obtained indirectly by showing that the recursive sequence can be 
approximated by a sequence satisfying a recursion of simpler (Robbins-Monro) 
form for which convergence results applicable to our situation have recently 
been obtained. 



1. Introduction and overview 

Our focus is on estimating the coefScient 9 of an invertible scalar moving average 
model of order 1 (MA(1)), 

(1.1) yt = eet^i+et 

where Ct is treated as an unobserved, constant-variance martingale-difference pro- 
cess. We do not assume the series j/t,— 00 < t < 00 from which the observations 
come is correctly modeled by They can come from any invertible autoregres- 

sive moving average (ARMA) model or from more general models; see Section [51 
What we seek is a 6* that minimizes the loss function 

(1-2) L{e)=E[iyt-yt\,_,{9)n^E[eU0)] 

where et{0) = yt — ytlt-iW ^-nd yt\t-ii(^) is the one-step-ahead-prediction of yt from 
ys, —00 < s < t — 1 based on the model defined by 9 (see (I2.7P below). We define 
optimal estimation procedures to be those whose sequence of estimates 9t minimizes 
()1.2p in the limit. This is a property of (nonrecursive) maximum likelihood- type 
estimates of 9, see Potscher [23|. 

In this article, we analyze a continuously indexed family of recursive procedures 
for estimating 9. Recursive procedures form an estimate 9t for time t using the 
observation yt at time t, the estimate 9t-i for t — 1 and other recursively defined 
quantities. Our family encompasses two standard algorithms. Recursive Maximum 
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Likelihood (RML) which is referred to throughout as RML2 [1^, |2l| , and the sim- 
pler Pseudolinear Regression (PL R) 1211 — also known as Approximate Maximum 
Likelihood (AML) [2J] and RMLi [ll|,l20|. More specifically, our general recursive 
algorithm generating 9t depends on an index < /9 < 1. The algorithm reduces 
to PLR when /5 = and to RML2 when /3 = 1. 

Our main convergence result, Theorem 14.11 is obtained by constructing an ap- 
proximating sequence 9t for which 6t ~ 9t holds and which satisfies a Robbins- 
Monro recursion, 

(1.3) et^et-i~Stf{0t-i,P) + 5tit, 

in which "ft and 5t > 0, 6t 0, X^fcLo = 00 a.s., and 

Here -^^^ denotes almost sure convergence (convergence with probability one) and 
gy{uj) denotes the spectral density of the time series yt. Note that when (3^0, then 



(1.5) f{0,O)^-J _^ ^^^^^^^ gyiuj)duj ^ -E[et-metm , 

and when /? = 1, then 

where L'{6) denotes the first derivative of L{9). We then apply a result of Fradkov 
implicit in [§| , as extended and corrected by Findley [§| , to show that 9t converges 
to {6* e e : fi9,/3) = 0} where 6 is the open interval (-1,1) of real 9 with \9\ < 1. 
(A similar result is implicit in proofs of Theorems 2.2.2-2.2.3 of Chen 0].) Hence, 
for /3 = 0, 61* ^ {6* e e : E[et-ii9)eti9)] = 0} and for /3 = 1, 6't ^ {6* G 9 : 
L'{9) — 0}. Here and below, 9t convergence a.s. to a set means that except on a set 
of ^ G S with probability zero, every cluster point of 9t{£,) is an element of the set. 

In the incorrect model situation, in which gy{uj) is not proportional to |l-|-0e*'^|^, 
for examples we have analyzed these zero sets will be disjoint, establishing that 
PLR converges to different values than RML2. Consequently, under the assumptions 
of Theorem 14.11 we recover the results of Cantor [J] that were given in separate 
theorems and proofs, establishing that, for certain families of AR(1) and MA(2) 
processes, RML2 estimates of 9 in the model (|l.ip converge to an optimal limit (a 
minimizer of (|1.2p ) whereas PLR estimates converge to a suboptimal limit [1, 

When the data come from an invertible MA(1) model, it is known that PLR 
and monitored versions of RML2 can provide strongly consistent estimates of 9 
12, 3- More generally, in the correct model situation for ARM AX models. 



i.e., ARM A models with an exogenous input, Lai and Ying [l3| provided a rigorous 
proof of strong consistency of PLR (under a positive real condition on the MA 
polynomial) and also of a monitored version of RML2 whose monitoring scheme 
involves non-linear projections and an intermittently used recursive estimator for 
which consistency has already been established. In Section 4 of Lai and Ying 
consider a simpler modification of RML2 in which, for monitoring, only auxiliary 
consistent recursive estimates are used. They present detailed outlines of proofs 
of strong consistency and asymptotic normality of the estimates from this new 
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monitored RML2 scheme. The construction of Section II of [3| can be used to 
obtain auxiUary recursive estimates with the properties required. 

There is a rather comprehensive theory of recursive estimation of autoregressive 
(AR) models, encompassing certain incorrect model situations for algorithms like 
PLR (see e.g., @). There are, however, no published convergence results with rig- 
orous proofs for MA models in the incorrect model situation. Ljung's seminal work 
on the convergence of recursive algorithms [2^, 'ill mentions the incorrect model 
situation but provides only suggestive results (further discussed in Section [S]) . 

This article has five sections. In Section[2l the assumptions on the data and some 
consequences for the MA(1) model are given. In Section [3l the general recursive 
algorithm is presented. The Convergence Theorem is stated and proved in Section[3) 
Required preliminary technical results are given in Section 14.11 and the proof of the 
theorem is provided in Section 14.21 Finally, Section [5] concludes the article with a 
brief discussion. 



2. Assumptions 

The observations > 1 are assumed to come from a mean zero, covariance 
stationary scalar series, yt, —00 < t < 00 defined on the probability space (S, P). 
We use the following additional assumptions on the process yt- 

(Dl) yi is nonzero with probability one; i.e., P{y\ > 0} = 1. 
(D2) The series has a linear representation 

00 00 

(2.1) yt — Kstt-s such that kq = 1 and \ks\ < 00 

in which k(z) = '^'^q k.sZ'^ is nonzero for \z\ < 1 and {ct} is a martingale- 
difference sequence (m.d.s.) with respect to the sequence of sigma fields Tt — 
a{ys, —00 < s < t). Thus E[et\J-t-i] = 0. By a result of Wiener [25|, Theorem 
VI 5.2], k(z)"1 = J2T=ol^'>^'' ■^it^ J2T=o lAI < °°' whence 

OC 

(2.2) = (/3o-1). 

(D3) The conditional variance i?[e^|jFt_i] is constant almost surely; i.e., 
E[et\Tt-i] = Equivalently, £'[ej] = a'^ and — cr^ is a m.d.s. with 

respect to the 

(D4) {et} is bounded a.s.; supj \et\ < K a.s. for some K < 00. 
From (D2)"(D3), the spectral density gy{ijj) can be expressed as 

2 °° 

(2.3) gy{uj) = ^ He"^)? where /«(e'") = V n^e'^^^ , 

27r ^ — ' 

3=0 

and 

(2.4) < m < gy{uj) < M < 00 for all -tt < w < tt 



for positive constants m and Af . The series yt is an invertible ARMA process if and 
only if k{z) is a rational function. 
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Assumption (D4) is used extensively in the proof of the convergence theorem, 
Theorem 14. II in Section [H 

Under (D2)-(D4), we can apply, for example, the First Moment Bound Theorem 
of Findley and Wei Jil] to show that t'^ J2l=j+iiysys-j ~ 7|) 0. Hence, from 
the particular case yt = e* in (|2.ip and j = 0, 

(2.5) t-^j2'l^al 

3=1 

We consider models for yt of the invertible, stationary first-order moving-average 
type (MA(1)) given by 

(2.6) yt^9et-i + et, -oo < t < oo . 

For a given coefficient 6 such that 16*1 < 1, the difference equation ()2.6|) is satisfied 
with et = et{0) given by the mean zero, covariance stationary one-step-ahead- 
prediction-error series, 

oo 

(2.7) et{9) = (1 + 9B)-'yt = ^(-e)^yt-j ^ yt - yt\t-i{0) , 

3=0 

from the MA(1) predictor yt\t-i{d) = - E^i(-^)^yt-j: see (5.1.21) of 3]. Here 
B is the backshift operator; i.e., Byt = yt^i- The coefficient 6 is referred to as the 
MA coefficient. Thus, 

(2.8) yt = etie) + eet-i{e) . 

The infinite series in (|2.7[) converges in mean square and, from (D4) and the rep- 
resentation ()2.1|) . also almost surely. Thus, et{9) represents the optimal one-step- 
ahead-prediction-error process from the perspective of the model (|2.6|) . The model 
p.6p is correct if et{9) coincides (a.s.) with the m.d.s. et in (12. 2p . in which case 
Ps = {—9y, k > 0. Whether or not the model is correct for any 0, forecast errors 
et{9) appearing in loss functions such as (|1.2p and elsewhere are calculated as in 
(|2.7p . We emphasize that (|2.ip allows data processes far more general than MA(1) 
processes. In particular, the z-transform, X^^o '^s'^* is not required to be rational. 
For example, time series conforming to the exponential models of Bloomfield 0] 
have non-rational k{z) without zeroes in \z\ < 1. 

Let 9 = (—1,1). From (|2.7p . the spectral density of et{9) is ge{9,uj) ~ 9y{^) ■ 
|1 + 9e"^\-^, so for 1(9) defined by dO]), we have 



By (|2.4p and the continuity of gy{oj), L{9) is positive, infinitely differentiable, 
and nonconstant on the interior of [—1, 1], i.e., on O, and infinite at the endpoints. 
Therefore it has a minimum value over [—1,1] and 



(2.10) Q* = 19 e [-1, 1]: 9 = arg min L{9) 

I ee[-i4] 

is a subset of [-K, K] for some < A' < 1. Also 6* C eg = {6* e 6 : L'(9) = 0}. We 
are interested in a.s bounded random recursive sequences 9t = 9t{^) that converge 
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a.s. to 0* or at least to Oq. If 8q contains only one point, 6'q, then 6t converges to 
a.s. Our results will establish convergence of the sequence of estimates 6t defined 
by the general algorithm presented below to the set of zeroes of f{0,/3) defined by 



3. The general recursive algorithm 

For < /3 < 1, we define a general recursion for estimating the MA coefRcient 6 of 











(3.1a) 


Ot 




bt^iet; 6ii = 0, i > 2, 


(3.1b) 


Pt 


1 




(3.1c) 
(3.1d) 
(3.1e) 


e* 
0t 

Xt 


= 2/t - Ot-ict-i; 
= Xt - 9t-i4>t~i 
= yt- (iOt-iXt- 


ei = 2/1, i > 2, 
; 01 = t > 2 , 
i; xi = yi, t > 2 . 



From (|3?Ta|l . it follows for < s < t - 1, t > 2 that 

(3.2) = et- Y,{t - ly^p-^-M-i , 

where J27=o(') = From (|3.1ep . 

(3.3) xt^Y.(-f^y{]l(^^-^]y^- 



1=0 



t-i 



s=0 



where nl'=i(') = 1- Next, let zi = ei and, for t>2, 
(3.4) zt = et+6't„i(/)t_i. 

The value of the parameterization with /3 is that it enables us to simultaneously 
obtain results for two important algorithms. When f3 — 0, then xt — yt from which 
it follows that^t = Ct and zt = yt and therefore (|3.1ap - (|3.1ep is PLR (AML, 
RMLi)[lll,0,[2l[2i]. When /3 = 1, then xt = and cjit = et - 9t~i<Pt~i and thus 



(|3?Ta|) - ((3li)) is RML2 [ij, l2l| without monitoring to ensure that each estimate 9t 
is in e = (-1,1). 

For any /3, these 9t can be expressed in the form of a regression estimate: 
(3.5) ^t^\j2'^l-i] il^s4>s-i, t>2. 



^s=2 ) s=2 



An induction argument for p.5p goes as follows. Set Pt = tPt = X;s=2 '^?-i- Note 
that from (Dl), Pf > for alH > 1 and therefore P^^ exists a.s. From p.lap - (l3.1ep 

and (EH), 6*2 = (l/2(/)?)"^ l/2(z20i) , which is dSH) for t = 2. Suppose then it is 
true for some t > 2; i.e., 

t 

(3.6) Pt9t = J2 ^^^'t>s-i . 
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Then 

Pt+iOt+i = Pt+i{Ot + Pt+\(/.tet+i) = [Pt + 4>l)et + 0tet+i 



Zs(j)s-i + 4't{<f>tOt + cj+i) (from the induction hypothesis p.6p ) 

s=2 

t t+i 



s=2 s=2 



Hence, (13.51) is true for i + 1 and by induction therefore for aU t. 

For use befow, we define the stationary anafogues et{9),Xt{9),(j)t{d) and Zt{0) of 
et,xt,4>t and z*: 

(3.7) et{e) = il + dBr'yt, 



(3.8) a;t(0) = (l + 0/3B)-iyt = X](-^^> 



<^t(0) = (1 + 0i?)-ixt(0) = J2i-dyxt-,ie) 

={l + 0B)-\l + epB)-'yt, 
so 0t(6l) = et{e) when /3 = 0. From (f3Jl) -([3J l) . 

(3.10) zti9) = et(0) + 9(t>t-i{e) = [(1 + 0B)-i + dB{l + dB)-\l + 9l3B)-^]yt 
From (i3J| -(|XT0 | . 

(3.11) mm] = £ ^ 



(3.12) 



and 



i?[<^._i(0)e,(f?)] = J ^ (i + ge»^)(i + ^^e-)(l + ^e-) ^^^"^^^ 

rff»(w)ciw, 



^ |(l + 6le''^)(l+/36le»'^)| 



(3.13) ^[^^W^^-iW] 

From HH) and (I5T^ . i;[0t-i(6')et(6')] = -f{0,P). Let e;(6') = det{e)/de. Then, 
from (P?7)) . 

Since 

i^i?[e?(^)]=i?[e;(0)e,(0)], 
from (|2.9p and p.l4p . the derivative of L{9), L'{9), is obtained from 

-L\9) = E[-e'ti9)eti9)] = /" ^^gy{uj)dLu 



(3.15) 



. |(l + 0e-)2 



-gy{uj)duj, 
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which is (|3.12p with /3 = 1, verifying (|1.6p . 

As a consequence of (2.4), we note that since \z\ < K* < 1 impHes < 1 — K* < 
\1 - z\ < 1 + K* , for (|3TTT|) with \9\ < K* < 1 we have 

m 1 , ^ , M 

(3-16) < I T7mi:i^j^7T-i^E:i:;^2ay{^)d^ < 



(l + X*)" -y-J(l + ee-)(l + /30e-)|2-^^^ ^ - [l-K* 



4. The convergence theorem 



The foUowing result is a generahzation of the PLR and RML2 results proved in [J] 
for MA(1) models. 

Theorem 4.1 (Convergence theorem). Consider a series yt for which (D1)~(D4-) 
hold. For each [3 such that < /3 < 1, assume that the recursive sequence defined 
by Il3.1a\) - i3.1e\} is such that, for some random k* = fc*(^) and K* = K*{$^){$^ S 5) 
satisfying < fc* < 00 and < K* < 1 , it holds almost surely that < K* 

for all t. Then for f{9,(3) as in |_/.4| ).' 

(a) The sequence 9t defined for t > 1 by 



(4.1) 



1 



+ 0,+fc.e-)(l + /30,+fc.e*-)|2 
cosw + (1 + (3)9s+k' 



Js+k 



:e*")(l + /36l,+fc.e''^)| 



gy{Lo)duj 
gy{ijj)duj 



has the property that 9t — 9t 0. Hence, with probability one, there is a 
toiO > 1 such that \9t\ < (1 + K*)/2 < 1 holds for all t > to{i). 
(b) For all t > to(0; satisfies a Robbins-Monro recursion. 



(4.2) 



% = 9t^i-6tf{9t-i,l3) + 5at. 



JS = to + l 



where f{9, (3) 



with "ft — ^ 0, (5t > a.s., St 0, and J2s 
has the formula |J.4| ). 
(c) From (a) and (b), it follows that, with O = (—1, 1), the sequence 9t converges 
a.s. to the compact set 



(4.3) 



e(^ = {0ee:/(0,/3) = o} 



in the sense that, on a probability one event :^o that does not depend on (3, for 
each ^ g So, the cluster points of 9t{£,) are contained in Qq. Further, when 
yt is an invertible ARM A process, then 0q is finite, and 9(^) = limt^oo ^t(C) 
exists for every G Sq . 



Note from ((3?5|l . ((3lT|l and ((3?T3)) that the assertion 9t - 9t 
Theorem 14.11 can be formulated as the assertion that 



in part (a) of 



Zs(Ps-l 



s=l ) ^ s=l 

t . 

-J2E[^U0.+k')] -J2E[zt{9,+k^)c^t-i 
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tends to zero a.s. In the expression above, (pQ — Q and expectation is taken before 
evaluation at ^s+fc* . 

The proof of Theorem 14.11 given in Section 14.21 In , we provide complete 
results concerning the existence of k* and K* with the required properties for 
several incorrect model examples as well as for the correct model situation for 
(3 ~ i) (PLR) and provide more limited results for the case /3 = 1 (RML2) with 
a particular monitoring scheme. For the latter case, we also report on simulation 
results which demonstrate the existence of the variates k* , K* as in Theorem 14.11 
with the consequence that monitoring becomes unnecessary for sufficiently large t. 
In the correct model case yt = Ott-i + e* with i.i.d. ct, Lai and Ying [19] show for 
their monitored RML2 that this happens a.s. and the conclusions of Theorem 14. II 
concerning our approximating sequence (j4.1[) apply. 



4.1. Preliminary results 

Here we present some needed technical results. We first quote, without proof, a 
powerful result from martingale theory 17|, Lemma 1, part (i)]. Unless specified 
otherwise, all limits (liminfs, limsups, etc.) are with respect to t and for simplicity 
the t ^ 00 will be usually suppressed. 

Proposition 4.1. Let {et\ be a martingale difference sequence with respect to an 
increasing sequence of a -fields {Tt} such that s\vp^E[\et\'^^\J't-i\ < 00 holds a.s. 
for some p > 1. Let Zt be an J-t^i-measurahle random variable for every t. Then 
ZgCs converges almost surely on and for every rj > 1/2, 



(El 



Since 




on "S zf = 00 




=1 ■ 

it is clear that a corollary of this Proposition is 



Proposition 4.2. Under the assumptions of Proposition if limsupi x 
E1=i z1 < 00 a.s., then t^^ E1=i ^sf-s 0. 

Recall from (|2.1|1 that yt = + E^i >^s^t-s since kq — \. A second consequence 
of Proposition 14.11 is 



Proposition 4.3. Suppose that the m.d.s. ct in (D2) is such that sup^ E[\et\'^P\ 
J-t-i] < 00 holds a.s. for some p > 1. Then for any sequence yt = yt — yt-i in 
which yt-i is J-t-i-measurable, it holds that liminf > a.s., where 

al=E[e}]. 

Proof. From ([2T|), yt = yt - yt-i = ct + St where Zt = -yt~i + E^i i^set-s is 
J^t_i-measurable since i^s^t-s is J^t-i-measurable by (|2.2|) and yt-i is Tt^\- 

measurable by assumption. Then 



(4.4) 
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Consider first the event that ^1 ~* ' < oo- Then Y^\=i ~^ and, 

by the preceding Proposition, t^^ X]l=i ^sZs — — > 0. Hence, from (12. 5p and the first 
equation in (|4.4p . Ihnt^^ J2l=i v1 ~ ^1 ~ "'c the assertion holds in this 

event. In the complementary event, X]l=i ^1 from (j4.4|) . it follows that 

1 * 

lim inf — = lim inf 

(4.5) 

= cr? + lim inf 



By Proposition 14. 1[ X]l=i ^s-^^/ -^s 0- Hence, the second expression in 
T5|) is nonnegative, and the proof is complete. □ 




Proposition 4.4. Under 1^2. 4\ ), for each (3 G [0,1], the function f{6,(3) defined 
by is infinitely differentiable on Q ^ (—1,1), and Oq defined by ^■3\ ) is a 

nonempty compact subset ofQ. In the case /3 = 1, Oq contains the (nonempty) set 
of minimizers over Q of L (6) defined by i2.9\} . 



Proof. The differentiability assertion follows from (|2.4|1 via the dominated conver- 
gence theorem. Except for compactness of 6q, which will be discussed below, the 
assertions concerning L (9) and f {9,1} were obtained subsequent to (|2.10p . The 
remaining assertions follow from the continuity of / {9, j3) and the limit properties 

(4.6) Yim J {9,13) = -oo 
and 

(4.7) lim/(0,/3) = cx3. 

Indeed, from (|4.6p -(|4.7 p . for any K > there exists an < e{K,(3) < 1 such that 
fi0,l3) < -K for all 9 e (-1,-1+e) and/(6l,/3) > /\ for aU 6* e (1-e, 1). Therefore 
f{9, (3) must change sign over [—1 + e, 1 — e]. Hence f{9, (3) is non-constant and has 
a zero in this interval and, moreover, 

©0 ^ [-l + ^'l-e]- Finally, since f{9, (3) is 
continuous on this interval, 0q is compact. An analogous argument applies to Qq. 
To verify (j4.6p . we note that gy{uj) = gy^—uj), — tt < lu < tt yields 

/ io, P)-~r ':2i!^i±R — 

7-. |(l + 0e-)(l + /?0e-)|'^ ^ 

Because < /3 < 1, for < e < 1 — (3 there is a (5 = d{e) G (0, tt) such that 
cos a; + /39 > e whenever |a;| < S and — 1 < 6* < 0. For such e, 5, we obtain 

cos oj + (39 / N , 
2 3w (^) 




lUJ \ 



(4.8) =<;/ +/ } '-^^^^^ ,gyHd. 

^ I I < -i-e*-)(l-/3e»-)r'' 

(4.9) + hm / Tjgy{uj)duj 
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because (|4.8|) is finite, whereas for (|4.9[) we fiave 

^ cosuj + pe 



lim / : : 25s/ i'^) duj 



s |(l + 6ie"^)(l+/36'e«^)|^' 

■s 

I , • , ■ \ I 2 

OO. 



1(1 + 6*6*'^) {I + /3ee"^)\~'^ duj = 

-s 

This yields (|4.6p . and (|4.7p follows by an analogous argument. □ 

Proposition 4.5. Let yt he an invertible ARMA process, then for each (3 G [0, 1], 
the set = {6* e (-1, 1) : f{e, (3) = 0} is finite. 

Proof. K (z) in (D2) has the form n (z) = 77 (z) / (j) (z) where rj (z) and (j) (z) are 
polynomials, of degrees d^, and d^, respectively, having no common zeroes and 
having all zeros in {\z\ > 1}. Setting z — e*'^ and h{z) = (1 + dz) (1 + pOz), we 
obtain from dz = izduj that 

-f{e,/3)^ r ^^^^±PS ^gy{cu)dcu 



{z + p9)r,{z)r^{z-^) 



'^T^i J\z\=i (z) h {z ^) (j) (z) (j) [z 1) 

{z + !3e)v{z){z'^^rj{z^^)} 



2« 7|.|=i ' h (z) {z^h (z-i)} (z) {z''*^ (z-i)} 

The function 

fzl = a^zi+'^*-'^^ (z + /3g)^(z){z'^^^(z-i)} 

^ ' h{z){z^h{z-^)}(l}{z){zd*<j){z-^)} 

is nonzero on {|z| = 1} and has poles interior to the unit circle at —6, —(30, at the 
zeroes of z'^'^(f> and, if 1 + c?^ — < 0, also at 0. If Zj,j — 1, . . . ,n are the 

distinct poles in {z: |z| < 1}, then, by the Residue Theorem of complex analysis, 
e.g., (4.7-10) of Henrici 13], it follows that 

n 

f{e,f3)^-J2^es,=^,w{z), 
i=i 



where, if Zj is a pole of order J > I, 

Res.=.^ w (z) = ^j-^^ Jim^ { (z - z,)' w (z) } 

Thus each IieSz=z w (z) is a rational function of 9, and therefore the same is true 
of / {6,(3). Consequently, / {9,(3) = holds for only finitely many 6* in (—1, 1). □ 

The final preliminary result addresses convergence of a Robbins-Monro type 
recursion that will be applied to demonstrate convergence of the general recursive 
algorithm. It is a special case of a correction and extension by Findley of a result 
that is irnplicit in the proof of a theorem of Fradkov presented in Derevitzkii and 
Fradkov [8| for the case of monotonically decreasing St. The result below is also 
implicit in the proofs of Theorem 2.2.2 and Corollary 2.2.1 of Chen 0] which cover 
the case of vector 6 more completely than Findley [9| . 
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Proposition 4.6. Let 6t, t > to be a non-stochastic, real-valued sequence satisfying 

Ot = Ot-i - 6tf{et-i) + 5au t > to 

for some real-valued function f{9), with ^t, t > to satisfying "ft ^ o,nd with 5t, 
t > to satisfying St > 0, <5f — > 0, and X)t^to+i St = co . Suppose there is a bounded 
open set Q on which f (9) is continuously difjerentiable and which is such that the 
sequence Ot enters Q infinitely often and has no cluster point on the boundary ofQ. 
Then 9t is bounded, and its cluster points belong to Qq — {0 ^ Q : f{9) = 0}, i.e., 
Ot — > 00- The set of cluster points is compact. If Qo is finite, then 9t converges to 
some 6* G 6o- 

4-2. Proof of the convergence theorem 

The proof of Theorem 14.11 follows from a set of technical lemmas and propositions 
given below. Proposition 14.71 provides a set of technical results needed to prove 
the Theorem's two main assertions: (i) the asymptotic equivalence of 9t and the 
sequence 6t (Proposition |4]8|) and (ii) (Proposition |4]9|) the fact that Ot satisfies a.s. 
a Robbins-Monro recursion of the form considered in Proposition 14.61 

Hereafter, K or sometimes k (or these letters with decorations) will denote a 
generic upper bound (not always the same one) that is finite, or when it is random, 
finite a.s. A random K will be shown as A'(^) with ^ G S on first appearance 
whenever the randomness is not immediately clear from context. Again, unless 
specified otherwise, all limits (liminfs, limsups, etc.) are with respect to t and usually 
the i — > oo will be omitted. The notation Oa.sX^) denotes convergence to zero with 
probability one. 

Proposition 4.7. Under the assumptions of Theorem \4-.l\ for the general recursive 
algorithm, the assertions (a)-(c) below follow: 

(a) liminf 0^ > cr^ a.s. and (t^^ X^l^i 0s)^^ < < oo , and thus, 
from L3.1b\) . PfT^ is bounded a.s. 

(b) Fort > 1, Cf = J2'^^o'^ji*)^t~j;<Pt = Ej°lo4 " E}lo«^j W<^«-J' 
and Zt — X^jlo '^jW^t-j where for every j, K^{t), K'j{t), K^{t) and Kj{t) are J-t-i- 
measurable. Moreover, there exist kj such that 

max{|Ac^^(i)|, 1 4(^)1, Wj{t)\, W'^.m < 

and kj < oo a.s. Hence, the sequences et,(f>t,xt and Zt are uniformly bounded 
a.s. 

(C) 0t~0t-l^Oa.s.{l)- 

Proof of (a). From (|3.1dp . 4)t = xt - Ot-iCt-i = y* - Ot-i{Pxt-i + Ct-i) . Since 
Ot^iiPxt-i + et_i) is J?^i_i-measurable, by Proposition 14. 3|, 

t 

(4.10) liminfi"^^0^ > ^2 ^ 

s=l 

Continuing, from (|4.10p . for any < ii < cr^, there exists to — to(ii,C) such that 
t~^ Y.l=i 't't > ^1 a.s. for aU t > to- Let L2(0 = mini<t<to I]l=i '/'s- Then 
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< L2 < OO a.s. This follows since to is finite and 4>t is a finite valued sequence 
with probability one, hence L2 < 00. Moreover, since 0i — yi, under (Dl) it follows 
that L2 > a.s. Hence, X]s=i 'f's)^^ ^ maxji]^^, L2^} < 00 a.s. and the proof 
of part (a) is complete. □ 

Proof of (b). Set 6*0 — 0. From ei — j/i and et = yt — Ot-iet-i,t > 2, it follows 
that ~ Hj for all j, that K!^{t) = kq for all t > 1, and that ^^{t) = Kj(t) — 

6t-iK^{t — 1) for all t > 2, j > 1. It follows by induction that 

min(j,t-l) I 

(4.11) K^^{t)^ J2 (-ly^^j-^n^*- where nti(-) = l- 

Since for some fc* finite, |6't+fc. | < 1 for all t > 1, we have that 16*41 < K{(^) < 00. 
First suppose that K < 1. Then from (14. Up . 

min(j,t — 1) I j 

1=0 i=l 1=0 

and since K < 1, ^2^=0 ^ Ej°!Lo ELo = Ei=o -^^'^ E^o I'^pI < 0° 

where p = j — I- So the result holds for the case of < A' < 1. 

Otherwise, suppose 1 < K < 00. For all t > k*, we have that \9t\ < K*{^) < 1, so 
K{£,) — X{£,)K*{^) for A > 1. For simplicity of notation, replace K* by p. We next 
show that nLi l^t-'l ^ ^''V' for I < t- First suppose t < k*. Then OLi l^**-*! < 
AV' < A'='p'- Next suppose t > /c* and ? < t - fc*. Then, HLi l^'t-d < < p'A'=' 
since \Ot-i\ < p for 1 < i < t - s* . Finally, suppose t > k* and I > t — s*. Then 
since I <t, 



1=1 i=t-s*+l 



Hence, generally JlLi \^t-^\ < X'^'p'- Setting = A'^* we have 

i=0 4=1 z=o 

and since jpl < 1, Ej^o < 00 a.s. 
Next, from (P^j) 

min(j,t-l) Z 

(4.12) 4(0= ^ (-/3)'^,_,n^t-., 

i=0 i=l 

and since < /3 < 1, an argument like that for et can be applied and to obtain the 
existence of a Kj such that 

00 

(4.13) In'^it)] < and < ooa.s. 

3=0 
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Continuing, since 0i = xi and (pt = Xt — 9t-i4>t~i for i > 2, it follows similarly 
that 

min(j,t— 1) ; 

(4.14) ^'^{t)= j2 (-i)'«^;wn^*-- 

l=Q i=l 

From (|4.12p and (|4.13p . substituting Kj{t) for Kj, the same kind of argument can 
be appUed to (I4.14p to yield 

(4.15) |4(t)| < >i'^ with k'^ < ooa.s. 
Finally, for t > 2, we have, from zt — ct ^ 6t^i(j)t-i , 

oo oo oo 

for t > 2 from which it follows that 

(4.16) K^^it) = K';{t) + - 1) , 

where K'tiit) = 0. Since sup^ |6't| < oo a.s., 

\K]it)\ < Kj' + sup|6lt|4-i a.s., 

where = 0, so there is a Kj such that |K|(t)| < k| and J^JLo < °° ^-S- 
t > 2. Since zi — ei, it thus follows that kj — maxj{|K||, satisfies 
J Kj < OO a.s. 

From this, we see that et,4'tTXt and Zt are bounded a.s. For example, 



< sup jetl^^Kj < oo a.s. 



-CXD<t<00 . 

J=0 



From gH])-g31D, and K]{t), k'^ (t), k'^ (t) and «;|(t) are each JPf_i- 

measurable for every j . Hence, part (b) of the Proposition is proved. □ 

Proof of (c). By parts (a) and (b), |0t -^t-i| < r^Pi^\et\\(f>t-i \ < t-^K{S_) where 
K{^) < oo and thus part (c) follows and the proof of Proposition l4.7l is complete. □ 

Lemma 4.1. Under the assumptions of Theorem \4-.l\ we have: 

(a) If kj{t) are J-t-i-measurahle such that \kj{t)\ < kj for j > 0, with X^j^o 
oo a.s., then for all p > 1 and each < j < oo, 



(4.17) 



and 



t /min(j,s-l) / \^ 

s=2 y 1=1 i=l J 



t I min(j,s — 1) ' ^ 



(4-18) ^E E ~^,-i{s)Y.{s-ir^P-ycly,-,-ies-^ 



a.s. 
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In particular, 

t /min(j,s-l) I 

(4-19) 7E E ^.-K«)n(-'^-*r'^->— 1 

(b) for any < j < 00 and i < j , 

t t 



(4.20) i E(4(^))'^L, = \Y. - *))'^-. + ■ 

S— 1 S — 1+1 

(c) For < jj < oc and j ^ /, then 

(4.21) 1 ^ ^'^{s)es-,Kf{s)es-i^O. 

s=max(j+2J+2) 

Proof of (a). By the boundedness of Pf^^,4>t,et (Proposition 14. 7p and since 

\iim{t)\ < i^m for all TO > and t > 1, 

t ( inin(j,s-l) I 



7E E ~^3-A^)i\{^-i)'^P:-^<l>s-^-Xe 

s=2 y i=l i=l 

, t / J min(j,s-l) / 

5=2 ym=0 i=l i=l 

t /min(j,s-l) ; \^ 

^^(c)7E E n(-^rM ■ 

s=2 y i=\ i=i I 

And since for all j > 0, p > 1, 

(s - min(j,s - 1)) 



t /min(i,s-l) / \ ^ * 

7E E n(-^rM ^fE' 

s=2 \ i = l 4=1 / s=2 



(|4.17p follows, as does (|4.19p . by the boundedness of £4. Similarly, 

t I min(j,s-l) 



'-'s — i — L^s — i 



\Y.\ E ^.-K.s)E(^-o-^^.-V 
s=2 y i=i i=o 

t /min(j\s-l) i \P 

(4.22) ^^^)\Y.\ E E('^-*rM 

s=2 y i=i i=o y 

t / min(j,s-l) ^ 

^^(^)fE E (-^-^r^ 

s=2 y 1=0 ^ 

and follows. □ 
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Proof of (b). From (|4.12p and the recursion (|3.1a[) for 9t, we have, for s > j + 2, 



I 

s — i 



1=0 1=1 

j I 



(4.23) '=° 

1=0 4=1 1 = 1=1 

where 

(4.24) «;j=(s) = ^(-/3)'«,_; Ylis - z)-ip7_i>,_,_ie._., 

i=0 i=l 

Continuing, from ((iTl|) and for s>j + 2, 

i = 4=1 

3 I 

= j2(-^y^3-i(') n (^—1 + - 0"'nr->.-4-ie.-4) 

i = 4=1 
i = 4=1 

(4.25) + ^(-l)'^-_,(s) [](s - »)-ip7_i 0,_,„ie,_i 

i=0 4=1 

= j2(-^y(^3-i(' - 1) + "^j-'(^)) n 

i = 4=1 
1=0 4=1 

= 4(s-l) + u;|(s), 
where from (|4.24p . 

i = 4=1 

3 I 



(4.26) . . , 

^ ' 3 3-1 rri I 

i=0 m=0 4=1 n=l 



1 = 4=1 
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By (I4T91) and (14:251) - (14:261) . 



£2 . 



s=]+2 s=j+2 

Applying an argument similar to that used for part (a), it follows by the bound- 
edness of /3 and 9t and the Cauchy-Schwarz inequality that X]l=j+2(^'*i ~ 
l)w1{s) + {w'^{s)f)el_^ = Oa.s.H). Hence, 

s=]+2 s=j+2 

Finally, since j is finite, then for i < j, it follows by applying the recursion (|4.25p 
in K^(t) i — 1 additional times that (|4.20p holds, because a finite sum of Oa. s.(l) 
terms is Oa.s. (!)■ 1^ 

Proof of (c). By parts (a) and (b), for j ^ I, 
1 * 

s=max(j+2,;+2) 

inin(j,s — 1) 



s=max(j+2,i+2) k \ P=0 



(4-27) , . 



X 

9= 



7 E U^'(^-i)+ E 

9=1 / 

x(«:f(s-i)+ E 

n=l / 

7 E Kj'(s - l)Kf (s - l)es-jes-i + Oq.s.(I)- 



r=0 



X 

m=l 



s=max(j+2J+2) 



Without loss of generality, suppose j < I < oo. From parts (a)-(b) and applying 
the argument that led to (|4.27p j — 1 additional times, we have that 

1 * 1 * 

j'^l^jis)4is)<^s~3<^s-l^ J E K'^is-j)4is-j)<^s-3es-l+Oa.s.{l) 

s=l s=j + l 

1 

1 * 

= 7 E '^'j(^)'^ti^)^s-il-j)^s + Oa.s.(l) , 

since by (D4) and the fact that < i^(^) < oo for all m > 0, 

t 

E K^*(s)Kf(s)e^_(i_j)es = Oa.s.(l) . 



36 J. L. Cantor and D. F. Findley 

Since j < I, es_(;_j) is JF^-i -measurable, as the cr-fields are increasing. Set Zg = 
Kj{s)Kf {s)es_(^i_j-j , which is ^s_i -measurable by part (b) of Proposition l¥771 Then 
from boundedness, hmsup | ^*^^ < (supj |K'^(i)|)''(supt |et|)^ < oo , and thus 
from Proposition |4?2l Sl=i ^s^s ~^ and therefore (|4.21|) holds and the proof 
of the Lemma is complete. □ 



Lemma 4.2. For each u>0, under the assumptions of Theorem \4.1 
(4.28) M I +r,{t,u) 



s=l s=l \]=Q ) 



2 

2 * 



where lim„limsupj |ri(t, u)| = 0. 
Prooj. 

Let ri(i, u) be the sum of the last two terms. Recall from Proposition l4.7l and (|4.15p 
that < where X]j!Lo < 0° a.s. From this and (D4), it follows that 



^E E4(*)'^«-J E ^'ksYs-i 

2 



{u oo ( ^ ^\ \ 

E E + E 

and consequently that (|4.28p holds. □ 
Lemma 4.3. For each u > 0, under the assumptions of Theorem \4.1\ 

(4.29) 7 > : I > : I = ^ > : > : ( ) ' + oa.s.a). 



7E E4(^K-. =^EE(4(^))' 



Proof. 

\t (t-n-^)^s-) =^EE(4(^))^^^-. + iEE4(^K-.-f(^K-- 

s=l \3=0 J s=l j=0 s=l j^l 

Since u is finite, by Lemma |4. 11 part (c), 

^ t u 
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and SO it remains to consider Sj=o('*i (^))^^s-j- Consider the martingale 

difference sequence ej = — E[e^\Tt-i] = - al (recall that E[e1\Tt-i\ = cr^). 
From (D4), it is bounded a.s., hence sup.^j^^t^o^ i?[|et|P|jFj_i] < oo a.s., so we can 
apply Proposition 14.21 to et- 



For any j < s, consider t ^ J^l^ii^j {s))'^es- Since limsupt ^ J2l=i{Kj {s))'^ < 

oo, by Proposition lU ^*^,(4(s))2e, ^ 0, hence, " 

cr^) 0. By an argument like that used to prove part (b) of Lemma l4.H it follows 
that 



s—l s— j+l 

1 * 



i.e., ^""^ X]l=i('^j ~ '''e) fo'' J — Finally, since u is finite, 

^"^ELiEj=o(4(*))^(^«-i ~ '^^^) ^ 0> and (l4:29ll holds and the proof of the 
Lemma is complete. □ 



Lemma 4.4. Under the assumptions of Theorem \4-l\ for each u> and < k* < 

oo, we have 



T E E (4(^)) = T ^ ^ E(-/5^-- )^-.--. 

(4 30) «=iJ=o s=ij=o\;=o p=o j 

+ Oa.s.(l)- 

Proof. First suppose fc* = 0. Recalling from (I4.12p and (I4.14p . for s > j + 1, 



I 



s*(^)=E(-i)s-^(-'*)n^^ 

1=0 1=1 

(4.31) = ^(-1)' (Y.{-f3rn,^i-p n ri 

i=0 \p=0 r=l / i=l 

From (1221) and (|i3T|) . it follows that for s > j + 1, 

= E(-i)''*^'(^) n = E(-i)'^-i^^'(^) n 

1=0 i=l 1=0 i=2 

j _ I 

(4.32) = E(-l)'(^'^ - ^-'Ps^'<l>s-iesKj-iis) n 
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3 I 



1=0 i=2 

j _ I 

1=0 i=2 

Next, taking the square of (14. 32^ . we obtain 
\i=a 1=2 / 



1=0 



(4.33) 



m=0 I \i=2 / p=2 

\i=0 i=2 ) 



and from the boundedness of Bt and an argument like that used to prove l|4.17p . it 
follows that 

(4.34) "1 = y E fE(-l)'^s«,^_z(s)n0.-.) +o,.,.(l). 

s=j+l s=J + l \i=0 i=2 ) 



Consider next the r.h.s. of (|4.34p . From (|3.2 
E(-l)'^.«J-;(^)n^' 

i=2 

3 I 

=E(-i)'^.^^-2«^,(.s)n^-» 

1=0 i=3 

=E(-i)'^?-^(.^)ri 

1=0 i=3 
J 1 

- E(-l)'^^ E - ™)-in-\„</>._™^ie.-„«:,-_;(s) n^.-.- 

i=0 m=0 i=3 

Therefore, again from boundedness of Ot and an argument like that used to prove 

63ZD, 

f E(4W)' = T E fE(-l)'^?-|-/(-)ri^-^) 

s=j+l s=j + l \/=0 1=3 / 



1=0 i=2 
3_^ 

1=0 i=3 
3/1 _ \ '■ 

=0 \ m=0 / 1=3 

3 I 

i=0 4=3 

3 1 i 



Recursive estimation of possibly mis specified MA(1) models 



Applying the argument I — 2 additional times, it follows that 

(4.35) ^ = y E {jli~(^sY^U(s)\ +o,.,.(l). 

Next working on the r.h.s. of (|4.35p . from (I4.12p : 

j j / P \ 

1=0 1=0 \p=0 r=l / 

1=0 \p=0 r=2 

1=0 \p=0 r=2 ) 

1=0 \p=0 r=2 J 



Hence, 



T E (E(-^^)'«f-(^) 



t 

s=3 + l \l=0 



3-1 



= T E \Z^-(^^fY.^-py(^s^,-i-pX{e,A +o_(i). 

s=j + l \/=0 p=0 r=2 ) 

Applying the argument p — 1 additional times, it follows that 

2 t / 3 \' ^2 * / J 3-1 

f E m-^^y-ui'^A = tT. E(-^^)'E(-/5^^)%--. 

s=j + l \i=0 / s=j + l \/=0 p=0 

+ Oa.s.(l) > 

and, since j is finite, 

^E(4(^))' = T E fE(-e.)'E(-/3e.r«,-;-pl +oa...(i) 



Finally, since u is finite, (|4.30p follows for k* — 0. 
From ([321), for any finite fc* > 0, 

fe'-i 

Os+k" =0s+ ^ (s + fc* - P^^j,, _^(j)s+k' -r-lEs+k" -r ■ 

r=0 

Set 

fc*-i 

^(■S, fc*) = E ('^ + ^* ~ ry^P^+k'-r'l's+k--r~ies+k'-r- 
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For every integer I > 0, the binomial formula yields 
Substituting this result into the r.h.s. of 

s=l s=j + l \/=0 p=0 / 

which follows from Lemma 14.11 and noting that each resulting term involving 
X{s,k*) is Oa.s.(l) by (|4.18p . the proof of (|4.30|) and of the Lemma is reduced 
to the result just established for fc* = 0. □ 

Lemma 4.5. Under the assumptions of Theorem \4-.l\ for any finite u, 

2 t u 2 ^ ^ 

(4-36) y E E - 1)^-. = T ^ ^ - 1) + 

s=2j=l s=2i=l 

Proof. Since u is finite and for any finite j < u, linisupi~^CT^| ^*^2 ^ 
K^_]^(s — 1)1 < oo, then the result follows by an argument similar to that used 
to prove part (c) of Lemma 14.11 □ 

Proposition 4.8. Under the assumptions of Theorem \4.1\ the sequence {9t} defined 
by 14.1^ satisfies 6t - Ot ^ Oa.s.(l). 



Proof. For simplicity, first assume that fc* = 0; i.e., 16*41 < K* < 1 for all t. From 
the results of Proposition l4.7l and Lemmas 14.21 14.41 for any u < oo: 

1 * 1 * / " \ ^ 

7 E = 7 E E + (Lemma 

s=l s=l \j=0 J 

= ^EE(4(*)) +Oa.s.{l) + ri{t,u) (Lemma ESI) 

=fEE(E(-i)'n^-E(-/5)''^^-'-pn^-0 + '''^■^■^^^ 

s=l j=0 \/=0 i=l p=0 r=l ) 



+ ri(t,u) 

tEE(E(-^^)'E(-'^^^)'^^-'-?') + 



■ , ^ 2 

J-' 



+ ri , u) (Lemma I4.4p 

where lim„limsupj |ri(i, u)| = 0. By (I2.3|l . Parseval's relation and convolution [25 
pp. 61-66], it follows that 

2 

2 * CO f j j-l \ 

tEE Em^)'E(-/?^^)%--p 



^ 3 = 1-^-^ 



|(l + 0,e-)(l + /?0,e-)|: 



:gy{uj)duj, 
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and so 



1 



where 



|(l + 0,e-)(l+/30,e-)l' 



2 t oo / j j~l N 



t 

s=l j=u + l \l=0 p=0 

Since \9t\<K* < I, ii follows that 

2 t oo / 3 j-l \ 

tE E E(-^^)'E(-/^^^)^-.-'-p 

s=l j=u+l \l=0 p=0 / 

2 oo / i J-' 

E E(^*)'E('3^*)''^. 



j-i-p 



j=u+l \l=0 p=0 



because E.'lo (ELo(^*)' Ep=o(/3^*)''«j-i-p) ' < oo- Hence, 



hmlimsup^^ ('^(-0.)'|^(-/30.)%_i_p') =0, 



and consequently, lini„ lim sup^ \r2{t,u)\ = 0. It follows that 



(4.37) 



S=l 8 = 1"'-'^ 



1 



gy{uj)du 



0. 



Next, for s > 2 we use Kj(s) = ^^(s) + Os-ii^'j^i{s — 1) from (|4.16p to obtain that 
for any u < oo, 



ts-l-i 



- ^ Zs</'s-i = E E '^i (s)es-j E ~ 1)^* 

s=2 s=2 j=0 /=0 

= E E '^i E " + r3(t, u) 

s=2 j=0 1=0 
^ t u 

= i E E ^1(^)4-1 - 1)^-. + + ^3(i, 
= i E E { ('^K^) + - 1)) - 1)} 



s=2 j=l 

+ Oa.s.(l) +7'3(^, w) 
i u 



(4.38) 



^EE-.^(^Xi(--i)^^ 

s=2 j=l 



s=2 i=l 
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2 * " 

= '^j - 1) (Lemma 1131) 

s=2 j=l 
2 t M 

EE 

s=2 j = l 

where 



^ t / oo u \ 

r3(i,") = -E E '^■(^K-.E'^f(^- 1)^-1-0 
+ iE E^.'W^-^ E '^f(^-iK-i-J 

s=2 yj=o i=ti+i y 

+ iE E '^K^)^-. E «f(^-iK-i-H- 

s=2 yj=ti+i i=u+i J 

By an argument similar to that apphed to ri{t,u) in the proof of Lemma 14.21 
one obtains Um,(hmsupf \r3{t,u)\ = 0. As shown above, the second term of (j4.38p 

^-^2 ^*^2 ^s-i [i^'j-iis - 1)) , is equal to 



with 

r4 



s — 2 j=u+l 

and lim„ limsup^ |r4(t, =0. Hence, it remains to consider the first term of (j4.38p . 
From and (gSJ), 



fEE-K^)4-i(--i) 

s=2 j = l 

2 t « f J 

^EE E(-i)V.n^ 



I 



s=2 j=l k (=0 j=l 

X E (-1)" n E n ^-i- \ 

{m=a p=l \ n=0 r=l / J 

= f EE Em^)''^^-0 E(-^^r E 

s=2 j=l I \i=0 / \m=0 n=0 

+ Oa.,.(l), 

and, since again by (j2.3|) . Parseval's relation and convolution, 

^'E{fE(-^s)'«:,-;) fEM.)™'E i-posT^.-i-i-n]] 

j=l {\l=0 I \m=0 n=0 / J 

1 e*" 

-gj^(w)dcj. 



, (l + 0,e— ) (l + 0,e-)(l + /30,e-)' 
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the first term of (|4.38|) . t Yl\=2 (-^ ~ 1); is equal to 

t 



1 



with 



^ (1 + Ose-'-'^) (1 + 6l,e'"^)(l + 



gy{uj)duj + r^{t, u) 



s— 1 j—u+1 



\l=0 



\m=0 n=0 / J 



+ Oa.,.(l)- 



An argument hkc that apphed to r2{t, u) yields lim„ limsupj 1^5 (i, u)\ =0. Further, 
since 

1 e'"^ 

5y(w)(iti; 



_^ (1 + Ose-"^) (1 + ese"^)il + /36l,e*'^) 



+ 



, |(l + 0,e'")(l + /?0,e'-)|2 

e"^(l + /36'^e-''^) + 6'^ 
, |(l + 0,e-)(l + /30,e-)|2 

e'" + (1 + 



we obtain 
(4.39) 



, |(l + 0,e-)(l + /30,e'-)|2 
e"^ + (1 + /3)6'. 



gy{uj)dLU 
gy{uj)duj 
gy{uj)duj, 



|(l + 0,e-)(l+/30,e-)|: 



;gy{uj)du. 



0. 



Combining (|4:37)) and ((439)l . it follows from ([33]) and ((XT6| that Ot-Ot^ Oa.s.{l) 
where 6t is given by (|4.ip . Finally, since k* is finite, an argument similar to that 
used for Lemma 14.41 can be applied to show that (|4.ip holds for the general case 
k* > 0, completing the proofs of the proposition and part (a) of Theorem 14. II □ 



Proposition 4.9. Under the assumptions of Theorem \4-l\ cind with to = io(C) '^■s 
in (a) of the Theorem, 6t defined by satisfies the conditions of Proposition 
for Q = O = (—1, 1) for a Robbins-Monro recursion with f{9) = f{9, (3) as in 



Proof. For t > 2, set 

* ^ /"^ 1 

Then from (liTTj) . 

_ 5-1 [y^ r e'" + (l+m+fc. 

lA An\ ^ r e'" + (1 + m+k-' t ^ , 
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eJ^ + {l + /3)et+k' , ^, 



|(l + 0t+fe.e-)(l+/30t+fc.e-)| 
a ^ p-i / r e- + (l + /3)gt+fc» . . , 



= -5t/(^t_i,/3)+5t7t, 
where, for t >2, 



(4.41) = 



-1 1 



and, for t > to + 1 with to as in (a) of Theorem 14.11 (which guarantees that f{6t-i,P) 
below is finite), 



(4.42) ^ ^ 



|(l + 0t+fc.e-)(l + /30t+fc.e-)|2 



gy{uj)du 



For |0| < i^* < 1, it foUows from (|3.16p and (I4.4ip . there exist finite, positive 
Kiii) < K2{0 such that < ki{C) < tSt < K2{0 < oo- From this, it follows 
that St and > -^i ''■^^ ~* ■ Next since k* is finite, it follows 

from 0t-i - 9t-i = Oa.s.(l) (Proposition |4?7l) that 0t+k* - dt^i = Oq.s.(I) and 
f{0t+k',P) - f{Ot-i,P) = Oa.s.{l). Hence, jt ^ 0. The definition of to in (a) of 
Theorem 14. 11 guarantees that the remaining condition of Proposition l¥!Bl is satisfied, 
so the proposition is proved. □ 

We can now complete the proof of Theorem 14.11 By Proposition 14. 6i dt Oq 
and therefore also 9t Qq, which is compact by Proposition 14.41 Further, if yt 
is an invertible ARM A process, then by Proposition 14.51 the set 6q is finite and 



Recursive estimation of possibly misspecified MA(1) models 



45 



Proposition [46] shows 9t converges on almost every realization to one of the finitely 
many 6 G 0g. Consequently, on the probability one event on which Of converges, 
its limit is a random variable 6 with finitely many values. On the complementary 
event, 6 can be defined to have any fixed value. This completes the proof of part (b) 
and with it the proof of the Theorem. 



5. Discussion 



The results obtained here provide a rigorous foundation for analyzing PLR and 
RML2 for MA(1) models. An important conclusion from our results is that under 
misspecification, generally only RML2 (i.e., the general algorithm with /3 = 1), not 
the simpler and more frequently considered PLR algorithm, can produce optimal 
coeflScient estimates in the limit. In Theorem 14. II is applied to address conver- 
gence of PLR and convergence of RML2 with a specific monitoring and modification 
scheme to ensure that iterates satisfy \0t \ < K* < 1. In 0] we also provide a set of 
examples that show that the limits of 9t from PLR and RML2 can differ. 

Ideas and techniques from the analysis of Hannan of RML2 for ARMA mod- 
els played a key role in our analysis, particularly the idea of approximating the 
recursive algorithm's sequence by a sequence made more analyzable, replacing cer- 
tain terms by their expected values, and replacing terms in an expression by finitely 
lagged values, as in our (4.20), so that martingale results like Propositions 4.1 and 
4.2 can be applied. However we note that, because of a neglected Oa.s.(l) term that 
depends on 9t, Hannan did not actually establish that his auxiliary sequence, which 
we denote by 9t to distinguish it from our 9t, satisfies his (nonstandard) recursion 
scheme. Also, the convergence analysis he indicates for 9t, if its details could be 
verified, would only establish that the limit inferior of mingggi \9t — 9\ is zero a.s., 
see p. 773 of Hannan The stronger result with the limit is needed to establish 
convergence of the original recursive sequence to On. More information about prob- 
lems we encountered with analyses in Hannan |12l | can be found in 4, Appendix 
E]. 

The approximating sequence technique is similar to the Ordinary Differential 
Equation (ODE) method independently developed by Ljung and Kushner 
[il [13. Specifically, the ODE method is a technique for providing asymptotic 
analysis of a time series (discrete stochastic process) via a deterministic continuous 
time stability analysis of a set of ODEs. For example, from the ODE method, Ljung 
makes convergence assertions for both PLR and RML2 for ARMAX models includ- 
ing in the incorrect model situation 21|. Like Hannan, however, the analysis is 
incomplete. In the rigorous treatment of the ODE method presented by Benveniste 
et al [ij only the correct model situation is considered. Their results, however, do 
not apply to PLR or RML2 0, pp.65-67]. 

Clearly, the boundedness assumption (D4) is restrictive but it is typical in con- 
vergence analyses like ours. For example, boundedness is an explicit assumption in 
the deep correct model results obtained by Lai and Ying [l^, equation (1.3)] as well 
as Ljung's ODE method assertions [U condition S2, p. 191] and is also required in 
the treatment by Benveniste et al. in which 9t is assumed to be bounded to obtain 
verifiable conditions to prove asymptotic results [J, Theorem 15 and Corollary 16, 
p.238]. 

Finally, it is likely that Theorem 14.11 is generalizable to higher order moving 
average models and quite possibly ARMA models. However, to obtain convergence 
results, a multidimensional parameter vector 9 version of Proposition |4]6] is needed. 
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The proof of Theorem 2.2.2 of seems to provide the needed result if it can be 
shown that an appropriate Liapounov function exists for the vector- valued f{9,j3) 
associated with multidimensional for < /3 < 1. The generalization of the L{6) 
with vector 9 provides the Liapounov function for the case (3 = 1. 
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